月份：2015年2月

luarocks安装–Failed loading manifest

使用luarocks安装lunit，出现下面报错：

jerry@ubuntu:~$ sudo luarocks install lunit
Warning: Failed searching manifest: Failed fetching manifest for https://raw.githubusercontent.com/torc h/rocks/master – Failed downloading https://raw.githubusercontent.com/torch/rocks/master/manifest
Warning: Failed searching manifest: Failed fetching manifest for https://raw.githubusercontent.com/rock s-moonscript-org/moonrocks-mirror/master – Failed downloading https://raw.githubusercontent.com/rocks-m oonscript-org/moonrocks-mirror/master/manifest

Error: No results matching query were found.

经查发现https://raw.githubusercontent.com/torch/rocks/master/manifest这个地址无法连接。只好切换另一个服务器了

方法1：

sudo luarocks install –verbose –only-server=http://rocks.moonscript.org lunit

方法2：

jerry@ubuntu:~$ mkdir ~/.cache/luarocks/https___rocks.moonscript.org

jerry@ubuntu:~$ sudo wget https://rocks.moonscript.org/manifest-5.1 -O ~/.cache/luarocks/https___rocks.moonscript.org/manifest-5.1

 

 

查看端口是否占用

环境 ：CentOS

[root@sandbox ~]# lsof -i:80
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
httpd 1118 root 4u IPv6 9178 0t0 TCP *:http (LISTEN)
httpd 1255 apache 4u IPv6 9178 0t0 TCP *:http (LISTEN)
httpd 1256 apache 4u IPv6 9178 0t0 TCP *:http (LISTEN)
httpd 1257 apache 4u IPv6 9178 0t0 TCP *:http (LISTEN)
httpd 1258 apache 4u IPv6 9178 0t0 TCP *:http (LISTEN)
httpd 1259 apache 4u IPv6 9178 0t0 TCP *:http (LISTEN)
httpd 1260 apache 4u IPv6 9178 0t0 TCP *:http (LISTEN)
httpd 1261 apache 4u IPv6 9178 0t0 TCP *:http (LISTEN)
httpd 1262 apache 4u IPv6 9178 0t0 TCP *:http (LISTEN)

Spark Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient memory

环境：spark 1.1

spark-shell启用的时候一直出现这个提示：

Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient memory

查了一下午才明白，需要在master结点上做如下修改：

vi /etc/spark/conf/spark-defaults.conf

添加一项

spark.driver.memory=10g

注：spark.driver.memory表示master的memory大小设置， 而spark.executor.memory代表worker结点内存大小。